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Abstract 

The capacity of a relay channel with inter-symbol interference (ISI) and additive colored Gaussian 

noise is examined under an input power constraint. Prior results are used to show that the capacity of 

this channel can be computed by examining the circular degraded relay channel in the limit of infinite 

block length. The current work provides single letter expressions for the achievable rates with decode- 

0^ ■ and-forward (DF) and compress-and-forward (CF) processing employed at the relay. Additionally, the 

00 

cut-set bound for the relay channel is generalized for the IS I/colored Gaussian noise scenario. All results 
hinge on showing the optimality of the decomposition of the relay channel with ISI/colored Gaussian 

CO 

noise into an equivalent collection of coupled parallel, scalar, memoryless relay channels. The region 
of optimality of the DF and CF achievable rates are also discussed. Optimal power allocation strategies 
are also discussed for the two lower bounds and the cut-set upper bound. As the maximizing power 
allocations for DF and CF appear to be intractable, the desired cost functions are modified and then 
optimized. The resulting rates are illustrated through the computation of numerical examples. 
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I. Introduction 

The relay channel was introduced by van der Meulen [0, [@], [Q and extensively studied since that time. 
A significant set of contributions to the analysis of such channels was provided by Cover and El Gamal 
in @, wherein capacity achieving coding strategies were provided for degraded, reversely degraded 
and feedback relay channels. The bulk of the research on relay channels has focused on memoryless 
channels either with or without feedback (see e.g. Q, (H, O, iflOlO . In the current work, we determine 
the achievable rates and an upper bound on the capacity of a three node simple relay channel with 
intersymbol interference (ISI) and additive colored Gaussian noise. Such channels are of interest as most 
of the wireless standards are bandlimited in nature; further, underwater acoustic channels exhibit both 
ISI and colored noise (see |[12l . |[T3l , |[T4lD . It is needless to say that the problem is challenging as even 
the capacity of the simple memoryless relay channel is a long standing open problem with solutions for 
scenarios under very specific conditions (see rt9l. irTTI ). 

In this paper, we discuss two important coding strategies at the relay (a) the Decode-and-Forward (DF) 
protocol, and (b) the Compress-and-Forward (CF) protocol, and derive the corresponding achievable rates. 
In addition, we generalize the cut-set bound for the converse to our scenario of interest. As CF and DF 
have differing regimes in which they offer the best rate |0 for memoryless channels, it is of interest to 
investigate both coding strategies for the relay channel with finite memory and colored Gaussian noise 
as we do herein. 

Important prior work on this problem includes [15], which provided the link between circular multi- 
terminal networks with ISI and linear ones. A single-letter expression for the two-user broadcast channel 
is given in |fl5l : however, the computational methods used therein do not directly apply to our case due 
to the presence of the multihop link. In fact, the challenge for the three node relay network stems from 
the intermediate processing at the relay node. While the defining expressions for the capacity of the relay 
channel with finite memoiyo are provided in lH6l , a single-letter expression is not provided. As in |fl31 , 
ifTTl , |[T8l , we employ the discrete Fourier transform (DFT) to decompose our circular relay channel 
into a collection of parallel scalar relay channels. A key consequence of our work is that the parallel 
decomposition is optimal for the computation of both the DF and CF achievable rates and thus permuting 
channels at the relay [19] cannot improve the bounds. The resulting parallel relays are coupled via the 
power constraint for the DF case and via both a power and rate constraint for the CF case which affect 

'Classically, capacity computations in the presence of memory require examination of the entire signal due to the memory. 
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Fig. 1. Channel model of a single-relay channel 



the optimal power allocation strategies. 

Allocation of resources (power, bandwidth, bit rates) in the context of specific coding schemes are long 
studied in communication community, focusing mainly on one hop multi-user channels (see |[T5l , [18], 
[20]). In this paper we have studied the optimal power policy that will achieve the modified capacity 
bounds and also shown that in some of the cases simple water-filling type of power allocation at the 
nodes are optimal. 

The remainder of the paper is organized as follows. In Section II, we introduce the different channel 
models and we establish the equivalence between different channel models, while Section III computes 
the bounds on the capacity of n-block channel and the condition of optimality of the different achievable 
rates. In Section IV we examine the bounds in the limit of infinite block length. In Section V, we derive 
the power allocation strategies for our various bounds. Section VI provides a few illustrative examples. 
Finally, in Section VII, we present the conclusions of the work. 

II. Channel Models and Capacity Relationships 

In this section, we introduce our channel model and the related circular Gaussian relay channel building 
on the formulations of [15]. We consider the capacity of the discrete-time relay channel model as shown 
in Fig. 1. The signal transmitted by the source and relay are given by {xsk} and {xru}, respectively. 
The stationary, additive Gaussian noise processes at the relay and destination, denoted by {vr^} and 
{vDk}, have zero-mean, and autocorrelation functions Rr[1] and Rd[i\, respectively, of finite support 
imax- Let {hqi}iLoi Q £ {SR, SD, RD} denote the channel impulse responses (CIRs) of the three links, 
with common memory length m. Without loss of generality, we only consider the case, m > i r 
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2 If m < imax, CIRs can be zero padded to make them equal. 
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output sequences at the relay and destination are, {y R k} and {udu}, respectively, with, 

in 

URk = ^ hsRjXg^i) + V Rk , 

i=0 
m 

VDk = y^(hsDiX S (k-i) + hRDiXR(k-i)) + VDk- (1) 
i=Q 

The following power constraints are assumed for the source and relay signals, for all n, 

n 

-J2 E l x lk\ = -P«< P i, Q£{S,R}. (2) 

k=l 

For a given m, this channel is called the linear Gaussian relay channel (LGRC) with finite memory 
m (see lfT5l ) as the output is a linear convolution of the input codeword with the channel impulse 
response. Clearly the channels have ISI since the channel output at time k depends on the input symbols 
{xq(k)} q& {s,R} at trme & as wei l as previous input symbols {x q (i)} q& {s,R}^ < in addition, the noise 
samples {v q (k)} qe ^ RD y at time k is correlated with noise samples {fq(i)}ge{.R,D} at times i < k. 

We now define the n-block circular Gaussian relay channel (n-CGRC) for n > m, a n-block 
memoryless channel obtained by modifying the LGRC with memory m. This channel model will play a 
pivotal role in capacity computation as seen in the sequel. Specifically, the n-CGRC over each n-block 
has input vectors {xsk}k=ii { x Rk}t=i wnic h produce output vectors {y Rk }^ =l at the relay and {y c Dk }^ =1 
at the destination with, 

yf = H c SR x n s + vW, 

yl c = H c SD x n s + H RD x R + v n D c , (3) 
where H c is the circulant channel matrix, whose first row is defined as, 

H£(l,:) = [h q0 ,0,--- ,0,h gm ,--- ,h q2 ,h ql ), qe{SR,SD,RD}, 

and each subsequent row is a single cyclic shift to the right. 

The only difference with the linear channel model is that the channel output is the circular convolution 
of the input codeword with the channel impulse response instead of a linear one. The circular noise 
processes over each n-block {i^ fc }£ =1 , q £ {R, D} have periodic autocorrelation function and can 
be found in 031. Noise samples from different n-blocks are independent since the channel is n-block 
memoryless. The n-CGRC inherits the LGRCs power constraints. 

We next define key notation which will be used throughout the paper. We let S g = E[x q (x q y], and 
N 9 = E[v q c (v q c y], q € {S, R} be the source and relay input correlation matrices and noise correlation 
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matrices, respectively. We shall repeatedly make use of the fact that circulant matrices can be diagonalized 
by the Discrete Fourier Transform (DFT) matrix, which we denote as F. Thus, X™ = Fx™, q G {S, R} 
is the DFT of the input signal with ^ q = E[X™(X™)\ q G {S, R}. Also for a matrix A, |A| denotes 
the absolute value of the determinant of A. Additionally, the following diagonal matrices are defined: 

= FHfF f , / G {SR, SD, RD}, (4) 

C q = FN q Ft, q g {R, D}. (5) 

Finally, we define x n = x n s \x n R . Then, S = E[x n (x n )^] = E s - Eg^E^E^ and * = FEFt = 

Direct computation of the capacity of the n-block LGRC is challenged by the presence of inter-block 
interference. In lfT31 . it is shown that if we extend the definitions of the n-LGRC, the n-CGRC to a 
synchronous Gaussian multi-terminal channel, then the capacity region of the two multi-terminal channels 
is the same in the limit as n goes to infinity. As the relay channel is a special case of a synchronous 
multi-terminal channel, we get our desired result. Thus, the capacity C of the LGRC can be computed 
as the limit of the n-CGRC, as n grows to infinity. In the sequel, we derive single-letter expressions for 
a variety of rate bounds: achievable rates for DF and CF, and a generalization of the cut-set bound for 
the n-LGRC by exploiting this equivalence. 

III. Bounds on the Capacity of n-CGRC 

A. Achievable Rate: Decode-and-Forward 

Since the n-CGRC defined in Eqn. ® is an n-block memoryless relay channel, its achievable rate 
under DF coding strategy follows directly from ||6] if we replace (X,X\,Yi,Y) by x R , y 7 ^, ?/jrf). 
The DF achievable rate is thus given by 

C c nDF {P s ,P R )= sup^ ^mm{I(x n s ;y n R c \x n R ),I(x n s ,x R -y n D c )}, 

satisfying the power constraints given by d2j. 

To simplify notation, we define the following power constraint set 

f 1 - 1 71 

V D = {a(-),P s (-),P R (-) :0<a(w 4 ) < 1, - VP s ( Wj ) <P S: - V^(wf) < P R 



4 



Theorem 1. The achievable rate for a n-block CGRC with finite memory m, where the relay employs 
DF, is given by 

CnDF( p s,Pn) = maxmm{C^ nDF ,C^ nDF }, 



1 n 

where, C\ nDF = -Vc 



2nf^ \ N R (cji) 



C2nDF ~ ^^ c v^mJ' 



H q (Ui) = D qii , q G {SR, SD, RD}, (6) 
N q {u3 t ) = C qii ,qe{R,D}, (7) 

and 

P(ui) = \H SD ^i)\ 2 Psfa) + \H RD (oji)\ 2 P R (ui) + 2y/a(u i )\H S D(wi)H RD (u; i )\ 2 Ps(u) i )P R (u; i ). 

Additionally, C{x) = log(l + x). The H q (oJi) are the channel components for frequency bin i and link 
q; the N„(uii) are similarly defined noise components. The Ps{u>i) and P R (uii) are the powers allocated 
by the source and the relay, respectively, for i'th component of the channel and < a(u>i) < 1 is the 
cross-correlation between the input signals as defined in ^ and aioji) = 1 — a(ui). 

Before proving the theorem, we introduce two key lemmas. We first require a property of the maxi- 
mizing input probability distribution from liT6l . 



Lemma 1. I\16\l The capacity of the degraded relay channel with finite memory of length m is 
C DF = lim suv-min{I{x^y%\x R )J(x%x^y%)}, 

7i->oo q n 

where the maximization is taken over the input distribution q = Y\ji=iP( x Si\ x Si-li x Ri)p{ x Ri\ x Ri-i)- 

Lemma Q] implies that the process x R is allowed to evolve without any dependence on the process xs, 
while the process x$ may be causally dependent on x R . The key to showing Theorem Q] is proving that 
the DFT decomposition is optimal for DF. To this end, we must show that a certain correlation structure 
holds for the source and relay signals, x R and xs. 

Lemma 2. Given ^ R diagonal, for jointly Gaussian input (XS, XS) of the form of Lemma 1, the matrices 
^/,D will be diagonal if and only if an d ^?SR are diagonal matrices, where 

D = D S D^sD j SD +D RD ^ R D RD + 2Re(D S D^SRD RD )+C D . (8) 



Proof: For a given diagonal ^r, if <3/ g and ^ sr are diagonal matrices, it is easy to see that both ^ 
and D are diagonal. To show that diagonal ^ and D implies diagonal ^5 and ^sr for a given diagonal 
^>r, we proceed as follows. 

As the input vectors are jointly multivariate Gaussian we can decompose our source, in the DFT 
domain, into 

X n s = VX£ + WXg , (9) 

where, Xg,X R are the DFTs of the input symbols x"g,x R , V and W are general n x n matrices and 
Xg are a set of n independent Gaussian random variables, also independent of X R . From Lemma [T] 
it is sufficient to consider only lower triangular matrices V and W. Substituting the value of X$ from 
Eqn. © in if, we get 

where ^so is the covariance matrix of Xg , and is diagonal by construction. As the product of a non- 
singular lower and upper triangular matrix is diagonal if and only if they themselves are diagonal, W 
must be diagonal for ^ to be diagonal, as W is lower triangular and ^S>so is upper triangular. 

To show the related result for D, we first assume, without loss of generality, that the channel diagonal 
matrices are the identity. Then, substituting Eqn. ©, we have, 

D = (V + I)tf fl (V + I) t +W* S0 W t . 

As argued above for W, only a diagonal V, diagonalizes (V + T)^r(\ + I)t for a diagonal ^r. Since 
V,W and ^r are diagonal, ^5 and ^sr must be diagonal as well. ■ 
With Lemma Q] and |2] in hand, we can prove Theorem [TJ 
Proof: For the Gaussian relay channel 



ClnDF = I\ x7 S\yR\ x R) — HyFl\ x R) ~ HlJFi^R^ 



S) 



h(W SR x n s + v n R c \x R )-hog2ire\N R \ 



(a) 1 

< g l0g 27Fe 
(6) 1 

< - log 2ne 



D SR ml R + c R 



-log 27re|NK| 

ilo g 27re|Cji|, (10) 



where (a) follows from the fact that a Gaussian distribution maximizes the entropy; (b) follows from the 
fact that both the channel impulse response and noise correlation Nr matrices are circulant and thus 



can be diagonalized by the DFT matrix F and due to the fact that F is unitary and hence has a unity 
determinant. Similarly, 



°2nDF — 1 \ x S> x Ri Vd 



< 2 log 27re 



Dsd^sJ^sd +V RD y R rf RD + 2Re(DsD^SBn RD ) +C D 



=D 

ilog2vre|C D + D| - - log 2vre |C D | • 



-log 2TTe\Co\ 



(11) 



Equality occurs when the input vectors are multivariate Gaussian distributed. 

We assume, as in Lemma |2j that without loss of generality, the diagonal channel matrices are identity 
matrices. Thus we have 



2nDF 



(«) 1 
< - log 
~2 S 



Di + Vi* fl vJ 



(6) 



^log 



-1 



where, Vi = V+I and Di = Cd+W^'s'oW^ and (a) follows from making these substitutions in Eqn.dTTI) 
and (b) follows from the Generalized Matrix-Determinant Lemma |[22l . By Hadamard's inequality (see 
e.s. ll2Tl ). the determinant of a positive definite matrix is maximized when the matrix is diagonal, thus 
a diagonal maximizes C^nDF- ^ s we nave that a diagonal is necessary, Lemma [2] provides our 
final desired result. The final expression in the theorem results from manipulating Eqns.dTOli and (ITTb 
and employing the definitions in Eqns. © and (O. ■ 
The implication of Theorem [T] is that if we design xs in the DFT domain, a codeword which is white 
across sub-channels is optimal. This implies that treating the relay channel as a set of n parallel and 
independent scalar relay channels is optimum for the computation of the DF rate (as shown in Fig. 2). 
Thus, other kinds of relay processing such as permuting the channels via channel matching as was done 
in |[T9l for the multi-hop channel is sub-optimal, as one cannot exploit potential cooperative gain in 
a single sub-channel. Observe however, that the input power constraints are coupled for the n parallel 
channels. 
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B. Achievable Rate: Compress-and-Forward with Gaussian Input 

In DF, the relay completely decodes the source codeword and then retransmits a related signal of 
lower rate to the destination. In contrast, in CF, the relay quantizes the received signal and transmits this 




Fig. 2. Decomposition of relay with ISI into parallel memoryless relays in frequency domain 



quantized information to the destination. Since the maximizing input distribution is not known for the 
Gaussian CF relay channel, we consider inputs with normal pdf. 

Theorem 2. For n-block CGRC defined in the last section, the CF achievable rate with Gaussian inputs 
is given by, 

CnCF = SUp > — C P S (Ui) + , , (13) 

^)>0,l<i<n^ 2n V V J J 

subject to the input power constraint (0 and 

_ „ (\H SR (LOi)\ 2 Noioji) + \H SD (uif N(LOi)) +N(io i )N D (uj i ) 



\H SD {ui)\ Ps{ui) + \H RD (cji)\' P R (coi) + N D (u)i 



(14) 



where, N(u>i) = N R (oji) + N R (u>i) and N R (uJi) is the variance of the quantization noise in the i-th 
sub-band. As in Theorem\J} the H q (ui) are the channel components for frequency bin i and link q; the 
N q (u}i) are similarly defined noise components. The Ps(oJi) and P R {u]j) are the powers allocated by the 
source and the relay, respectively, for i 'th component of the channel. 

Before proving the Theorem |2] we introduce one key lemma which states the optimality of decomposed 
relay for the computation of CF rate. 

Lemma 3. A diagonal an d maximizes C^ CF in Theorem^ 



The proof of this lemma is provided in Appendix A. With the Lemma [3] in hand, we can now prove 
Theorem |2] 

Proof: As the n-CGRC with memory m is block memoryless, we can extend the CF achievable rate 
results for scalar relay channels ifD to the vector relay channels to yield the following lower bound on 
the capacity, 



C C nC F = BVV~I(xhV%,V?t\*R) 

with, I(x R ;y n D c ) > I(y n R c ;y R c \x R ,y n D c ), (15) 

where y T R is the quantized version of y R c and the supremum is taken over all joint distributions of the 
form, 

p(x n s ,x R ,y R c ,m c ,y n D c ) = K«SM^)p(»ff,»S ! xS > x5)p(figr||^, a! 5). 
Using Eqn. ® and our assumption of Gaussian inputs, we have, 

I(x&y%,y%\xl) = h(yl c ,y%\x%) - h(y%, y%\x% x n R ) 
( = } h(H c SD x% + H RD x R + vl c , y n R c + v n R c \x R ) - h(H c SD x n s + H RD x R + v n D c , y n R c + v n R c \x%x R ) 
(b) 1 



- log(27re) 



ret 



4 
SR 



(c) 1 



log(27re) s 



DsD^>S^l D + 



DsrVsI^sr + C R + C R 



ilog(27re) 2 



log(2vre) 5 



Nd 

N fl + N fi 

C d 

C fi + C fi 



(16) 



Here, (a) follows from the fact that the quantized version of y R c , y 7 ^ can be written as y 7 ^ + v 7 ^ 
from source coding theory (e.g. lliTI ). where v 1 ^ is a sequence of independent random variables (whose 
covariance matrix = F^C^F will be optimized to maximize the achievable rate), which are also 
independent of the input vectors and additive noises; (b) follows from the fact that the input vectors are 
jointly Gaussian, and (c) holds because both the channel matrix and noise covariance matrix N g are 
circulant by construction; hence they are diagonalized by the unitary matrix F. The inequality constraint 
with the Gaussian inputs can be simplified as follows. 

HxrIVd) = \ log(27re) \to SD * s Y)\ D + D RD * R rf RD + C D \ - h{y n D c \x n R ). 
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Similarly, for the RHS of Inequality (031 ). we have 

i{y n R-M\x%y n D c ) 
= h(r R c ,yl c \xl)-h(yl c \xi)-h(v%) 



-log(2vre) 2 



D SR v s iy SR + c R + c r DsR9 s n}} D 



Thus the inequality constraint is given by 



log 



> log 



D Sii tf sD^ + C R + C R 



Ky n D c \x n R ) - -log(2vre) 



-R 



VsrVsWsd 



log 



(17) 



D sd * s dL Dsd^s^ ] s D + C D 

DsD*srf SD + B RD ^ R D RD + C D . 

Now using Lemma |3j we can not only restrict an d ^r to be a diagonal matrices, but as with the 
computation of the DF achievable rate, a stronger result, which says that the CF achievable rate with 
Gaussian inputs is maximized when we decompose the network into n parallel, scalar relay channels, 
can be proved. 

Note that a diagonal ^5 and ^r alone does not achieve the desired decomposition into parallel relay 
channels as a diagonal ^5 and ^r does not block diagonalize the matrices in Eqn. ([ToT i and (fTTT ). The 
implied statistical independence by diagonal \&s and ^r coupled with a proper orthonormal permutation 
matrix does achieve our desired result, which we will show next. We define such an orthonormal 
permutation matrix, P, such that, 

P2j--i,j = 1 for j = I,-- - ,n 
?2j-2n,j = 1 for j = n + l,-- ,2n. 
Employing the defined P and using det(I n + PAP T ) = det(I n + A), we rewrite the Eqn.dToTl as, 



/~1C 

^nCF 



1 



log 



hn + 



cr 1 



- log 

2 B 



I 2 n + P 



-D 






Cr. + Cr 


Cr + Cr 



pTp 



Dsd^S^sd Dsd^S^sr 



(18) 



It can be easily shown that, 







Cr + C 



R 



10 



is a purely diagonal matrix, however if we treat it as a block- diagonal matrix, then its i-th 2x2 diagonal 
block is 



-i-l 

'Dii 







Cru + Cru 



whereas 



-i 



is a 2n x 2n block diagonal matrix where the i-th diagonal block is a 2 x 2 matrix given by, 

\H SD (oJi)\ 2 P 3 ( Ui ) HsD(vi)H$ R (ui)Ps(ui) 
Hl D (ui)HsR(u>i)P s (ui) \H SR (u>i)\ 2 P s (uh) 
Thus, the channel is decoupled, as the inputs corresponding to different coordinates do not interfere. 
Thus we have, 



l 

Nn(u>i) 






1 



VsDii^SiiD*SDn VsDii^SiiV*SRii 
T>SRii^SiiV*SDii VsRii^SiiD*SRii 



a 



nCF 



1 n 



x Si',UDii URi\ x Ri 



i=l 



Similarly it can be shown for the compression rate constraint ( fTTT ). With the decoupled channel, it is very 
easy to derive the expression in Theorem |2] ■ 
As obvious from the Lemma [3] that the decomposition across the frequency band is also optimal for 
the CF achievable rate just as with the DF protocol. But note that in contrast to the case of DF, the n 
parallel memoryless relay channels for CF are not only coupled via the input power constraints but also 
by the compression rate constraint. 



C. Capacity Upper Bound 

For the upper bound, we generalize the max-flow-min-cut theorem stated in |6), |[2ll for the block 
memoryless relay channel, 



1 



C^(Ps, Pr) = sup - mk{C, CZ P } where 



C% p = I{xfry%,y%\x n R ), 



The maximization is taken over the same input distribution as in the lower bound (see Lemma [T). For 
the Gaussian relay channel, using similar matrix manipulations as done in the cases of the achievable 
rates, we can obtain, 



1 



CZ P < TAC \a{uH)Ps{- 



^ 2 

i=l 



CO.: 



flHsR^ 2 , \H SD { 



+ 



y N R (oji) N D (u. 




(19) 
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where, P(u)i) is as defined in the Theorem 1. This result implies that decomposition of the network into 
parallel scalar relay channels can also be effectively employed in calculating an upper bound on capacity. 



D. Optimality of the achievable rates 

We next examine scenarios under which CF and DF are capacity achieving. To this end, we generalize 
the definition of degradedness []6| to the n-block memoryless relay channel as, 

Definition 1. An block memoryless vector relay channel {Xg x X^,p(y^, y^\xg, x^), y™ x y™) is 
said to be degraded if, 

p(y n R c ,y n D C \x n S ,xl) = p(yW\x n s ,xl)p(yl c \x%y n R ). 

An alternative statement of Definition 1 holds for the n-CGRC with ISI if we exploit properties of the 
DFT matrix and undertake some matrix manipulation: 

Definition 2. A n-block memoryless Gaussian circular relay channel is said to be degraded if the following 
condition is satisfied, 

i g "wr > \Hsppf t V1<i< „. 

where variables are defined as before. Thus, if the source-to-relay channel SNR is better than the source- 
to-destination SNR in all of the frequency sub-bands, then the circular relay channel is degraded. If the 
relay channel is degraded, then it can be readily seen that (see (61) the achievable rate using DF coding 
coincides with the cut-set upper bound. 

In contrast, with the compress-and-forward coding scheme, capacity is achieved if y 1 ^ is a deterministic, 
invertible function of the relay input y'jf. Appendix B provides a proof of this condition. For example, 
this condition can be realized when the relay and destination are co-located. In that case, the relay does 
not have to quantize its input y r ^ (y^ = y r j^) as the ultimate receiver at the destination can decode 
the uncompressed relay input because of physical proximity and hence the CF coding rate achieves the 
cut-set upper bound. This result is in accordance with the corresponding results on memoryless relay 
channels (see @) and will be emphasized with examples later in the paper. 
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IV. Limiting Capacity of the Relay Channel with memory 

As implied by the results in lfT31 . our desired capacity bounds for the linear Gaussian relay channel 
with finite memory will be obtained if we take the limit as n goes to infinity for the ra-CGRC capacity 
bounds. However, due to the presence of the relay, taking such limits requires careful treatment. In this 
section, we take such limits to yield the primary results of the paper. As before, we define the following 
power constraint set 

V c = |«(-), P S ('),Pr(') ■ < a(u) < 1,-^ ^ P s (oo)dLo < P s ,±- J W P R (u)(h> < Pr| . 
Thus, we have, 

Theorem 3. The achievable rate for a LGRC with finite memory m, where the relay uses decode-and- 
forward coding strategy, is given by, 

ClDF = _l j: n c ( aMl ^t } j 2PsM ) fa 

Cdf(Ps,Pr) = maxmm{C 1DF ,C 2 DF} where v 



and 



P(u) = \H S d(u)\ 2 Ps(") + \H RD (u)\ 2 P R (co) + 2^a(u) \H sd (uj)H rd (uj)\ 2 P s (u)P R (co). 

The proof is found in Appendix C. The cut-set bound for the relay channel with memory is similarly 
derived, yielding the result below, 

Theorem 4. An upper bound on the capacity of a LGRC with memory m is given by, 

r up _ 1 rir r ( , \ p / \ / \H SR (ui)\ 2 \Hso(uj)\ 



C up (P s ,Pr) = maxmin{C7,C2 P } where 

' 2 

where C2DF is as given in Theorem 3. 



V c /-cup r< 



Finally, we have the associated CF result: 

Theorem 5. The achievable rate for a LGRC with finite memory m, where the relay uses compress-and- 
forward coding strategy, is given by, 

c CF (P, AO = sup 1 I' c ( ftM ( + ., lHsR(u f, ) ) 



4nJ-* \ \ N d (uj) N r (u) + N r (cj) 
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subject to the input power constraints as in the earlier bounds and, 

r ( P s (lo) (\H S r(lu)\ 2 N d (lu) + \H SD (u)\ 2 N(lu)) + N(cu)N d (lu)\ 

logN R (uj)du > / log i = = '- duj. 

- ~ J-n \ \H sd (u)\ 2 P s (uj) + \H rd (uj)\ 2 P r (uj)+N d (co) J 

Proof: It is easy to see that the input power constraints and the inequality ([141 form a closed but 
non-convex constraint set. But as the objective function is continuous and bounded in [— n, n] and concave 
in Ps(u) and convex in N r (cj), by the properties of the Riemann integral Eqns. ([TBI and (fl4l converge 
to the desired result. ■ 

V. Power Allocation 

In this section, we consider the input power spectral densities (PSDs) for our bounds on the capacity 
derived in the previous sections (Theorems 3-5). As the maximizing PSDs appear to be intractable to 
compute, for both the DF and CF protocol, approximations will be considered to yield closed form 
solutions. To simplify the notation, we let the SNR of each link in each of the sub-bands be defined as 
follows, 

\H SR (ui)\ 2 \H SD (ui)\ 2 |iW^)| 2 



asm — — tt~, — v — i asm = — — \ — > a RD 



N R (u t ) ™ N D {ui) ™ N D ( Ui ) • 

A. Power allocation for DF 

We assume a total power constraint: ^ .fl n {Ps{^) + P R (oj))du) < Pt- The direct maximization over 
the power allocation appears to be intractable, thus we consider a lower bound on the achievable rate of 
Theorem [3] by exchanging the integration and infimum operations as, 

Cdf = maxmin|y C\(uj), J C2(u))X duj > max J min {Ci(uj), 6*2(0;)} duj, 

where equality occurs if and only if C\{oj) < 6*2(0;), Vw and vice versa. Theorem [TOl of Appendix 
C enables us to consider the power allocation problems in the continuous frequency domain via a 
finite dimension domain. We then take the limit as n — ^ 00 to get the desired result. Exchanging the 
integration and infimum operations further simplifies the n-dimensional optimization problem into n- 
parallel optimization problems corresponding to each of the frequency sub-bands, which will be solved 
subsequently. We observe that the resultant solution will be of a water-filling form. 

It can be shown that the optimization problem at each of the sub-bands is a convex optimization 
problem, which will yield the following solution, 
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Theorem 6. If a S m < a S Di 

PZ{u H )=(v t - — 
\ asm 

P* s (u H ) = P t *(u H ),P* R (ui) = Q; 



And if asm > asDi 



r>*, , (ii asRi ~ a SDi\ ( 1 
P t (Ui) = ( 1 + — ) ( v t 



asDi + aRDi J V asm 

j-) f , f , asm ~ asm \ ( 1 
P s [Ui) = 1 + asmj : To v t 



{asDi + aRDi) 2 J V a SR 

/ , asRi - asDi ( 1 
Pr\Ui) = aRDi-, ; ^ vt 



(asDi + aRDi) 2 \ a S Ri 
1 n 

Such that, — } P?(wi) = Pt, 

Tt L- — J 



n 

i=l 

where, x + = max{0, x). 

The proof uses the concavity of the objective function and standard convex optimization techniques and 
is summarized in Appendix D. For our modified cost function, the optimal input PSDs derived above all 
have a water-filling type of structure. Unfortunately, no such simple water-filling type of solution appeals 
to exist for the optimal power allocation problem associated with the upper bound. A more detailed and 
complex solution to this problem is discussed in ||23T| . 

B. Power allocation for CF 

In the achievable rate using CF coding, to simplify the inequality constraint, we make the following 
substitutions, 

- 1 + Psi(asRi + asDi) N Ri 
NRi = — Cj, qi ~ 



1 + asDiPsi 1 + Ci 

where q is a non-negative number. It can be easily shown that the CF achievable rate after the substitution 
is given by 

nc 1 i (1 + Psijasm + as Pi)) 2 

CnCF ~ SnP ^ 1 2 g l + Ps l (asm(l + qi )+a S D t y 

where the supremum is taken over the input power constraints and the following inequality, 

1 + Psi(asRi + a S Di) 



, , - + Psiasm + PmaRDi 

i=i i=i 
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The new parameter qi is thus, 

1i = 

1 + 



N R (jjj) (1+asmPs fa )) 
l+P s (ui i )(a SR i+asDi) 

N R (u)i)(l + Ps{ui)(asm + asm)) 



(21) 



(1 + N R (ui)) + Ps(ui)(a S Ri + (1 + N R (u3i))a S Di) 
Now, as the inputs and additive noises are Gaussian random variables, Eqn (|2TT > can be re-written as, 

hog(2ne)Var[q t ] = h(Y^\Y^ + h(Y m ,Y^\X Ri ) - h{Y^Y^\X Ri ) 

( = } h{Y m \Y^X Ru Y m ) + h(Y m ,Y^X Ri ) - h{Y^Y^\X Ri ) 

= h{Y^Y^X Rh Y^) + h{Y m \X Ri ) + h(Y^\X Ri ,Y m ) - h{Y m \X Ri ) - h(Y^\X Ri ,Y m ) 
= h(Y^Y^\X m ,YBi) - h{Y^X RU Y m ) 
= h{Y Ri \Y^X RU Y^\ 

where, (a) follows from the fact that Yj^ is a quantized version of Y^ and thus given Y Ri , Yj^ is 
independent of every other random variable. Thus, qi = Var[Y Ri j Y Ri , X R i, Y m ] and can be interpreted 
as the variance of the backward test channel with the side information (Xm^Y^) or Yg^ = Yg^ — 
^/a-RDiXtii. 

It is easy to see that the optimization problem described above is a non-convex one. The necessary 
conditions for the optimal solution using the Karush-Kuhn-Tucker (KKT) conditions are summarized in 
ll24l and the solution is given below for completeness, 

asffi(l -<?*) + {asm + a S Ri){a S Di + a S Ri{l + q*))Ps(uJi) 



2(1 + (asm + os ffi )i^(w < ))(l + (asm + a SRi {l + 

K( a SRi + {asRi + asDi)a R DiP R {ui)) 



2(1 + (asDi + asRi)Ps(uJi))(l + a,sDiP s (^i) + a R DiP R {tOi)) 

P*R^i) 



AS = 0, 



^--^—{l + asDiP* s {ui)) 



2A 



At 



1 



CLRDi 



1 + 



1 + a S DiP s {oJi) 



+ 



(22) 



asRiPsi^i) 

It is notable that P R (uji) is given by a water-filling solution and independent of asm, i- e -> the relay 
power allocation does not depend upon the characteristics of its incoming link. We can also see that q* 
is independent of a R m and decreases as asm increases, which implies that the relay bit-rate allocation 
does not depend upon the characteristics of its outgoing link. 
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As is obvious from Eqn (1221 . the optimal power allocation does not admit a classical water-filling 
form as in the case of the modified DF strategy discussed earlier. But by following |[25l . a much simpler 
and a convex optimization problem can be obtained by choosing, 

1 + (asm + asRi)Ps(^i) 
1 + a SDi P s (ui) + a RDi P R (uJi)' 

It can be easily shown that under this condition the achievable rate will be, 



> *SDiPsbH) + i +(asD<+aam) P s fo T 



CcFm = SUp 

such that the power constraints are satisfied. However, C^ CF > CcFm- 

VI. Illustrative Examples 

In this section, we discuss several simple examples to illustrate the computation and relationships of 
different achievable rates and the upper bound. We will start with simple example of relay channel with 
equal transmission bandwidth on all the links to illustrate how the theorems are applied and then move 
on to other, more practical, examples. 

A. Relay with equal bandwidths 

We examine the simplest case when all the channels are the same ideal low-pass filters of bandwidth 
W and the noise is AWGN (see Fig. 3). Let, 

W 

N r {uj) = Ni,N D (u) = JVi + N 2 = N, < u> < — . 

Z7T 
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Due to the common channel assumption and the noise variances, the relay channel is degraded. We 
make the following idealized assumption: we can achieve both strict bandwidth and time limitation 
simultaneously, the key is that we require finite memory. It can be shown that the channel capacity is 
given by, 

C = max mm W < C \ t^tt , C 



o<«<i [ \NiW J V NW J 

Uniform input PSD's achieve capacity, which is expected since all the parallel degraded relay channels 
are identical. This result is a generalization of the discrete memoryless Gaussian relay channel [6 | in the 
bandwidth limited case. If jf- < jr, then a = 1 maximizes the capacity and its given by WC ( J"^ ) and 



if & > P& then the capacity is given by WC , where a* is solution of = Ps+Pr + 2 ^° Ps ^. 



B. Relay with unequal bandwidths 

Our second example considers a single -relay channel with different bandwidths across different links. 
This type of channel is common in underwater communication where channel bandwidth depends on 
internode separation (see []28], ||29]). Let, Wsd,Wsr and Wrd(Wsd < Wsr,Wsd < Wrd) be the 
bandwidths of the three links (see Fig. 4). Furthermore, we assume that all channels are ideal lowpass 
filters. Noise is AWGN and has the same PSD as in the earlier example. It can be readily seen that the 
relay channel is degraded and it can be shown that the network reduces to a degraded relay of bandwidth 
Wsd and a 2-hop channel with link bandwidths Wsr — Wsd and Wrd — Wsd- Hence the capacity of 
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this channel is given by, 



C = mm IVsd < C -77777 — > ^ 



+ min <j (W SJl - W SD )C ( AWW Ps2 w ^ , (W RD - W SD )C ( ' >/>>2 



^(W^-Ws^y ' v ^ \N{W rd -Wsd), 
where, P$i + Ps2 < Ps,Pri + -Pr2 < -Pr- The decomposition is very similar to the decomposition 
observed in ifTOl for the rate-constrained relay channel, where because of the constraint on the relay 
encoding rate, the source splits its rate between direct transmission and cooperative transmission using 
relay. In our example, due to the excess bandwidth available on the 2 hop link, the source splits the rate 
between the two parallel sub-channels. 

C. Suboptimality of random permutation at relay 

In this simple example, we show that when sending indepepndent messages (the covariance matrices 
of Xg and X^ are diagonal) across the sub-carriers, the best permutation at the relay for the channel 
decomposition is to match the z-th sub-carrier of the source-relay channel to the i-th subcarrier of the 
relay-destination channel, i.e., any other permutation at the relay would be as good as no permutation at 
all. Consider a parallel relay channel with 2 sub-carriers, i.e., 

H q2 

where, q G {SR, SD, RD}. Let the relay employ DF processing, .i.e., the relay decodes the received 
messages in each of the sub-carriers of the source-relay channel and then according to a deternministic 
permutation function n : {1, 2, ■ ■ ■ , n} {1, 2, • • ■ , n} (n = 2 in this case), the relay sends the decoded 
message of the i-th sub-carrier of source-relay channel in the j-th sub-carrier of the relay-destination 
channel, .i.e., ir(i) = j. 

In our example, two different permutation functions are possible, a) ir(i) = 3 — i, and b) n(i) = i, for 
i = 1,2. We will compare the DF achievable rate of both the cases for an example channel and will see 
that it is enough to consider the permuting function n(i) = i for the relay (see Fig. 5). 

We observe in Fig. 5 that the two achievable rates match for low values of source power P$. This 
is due to the fact that if the relay power Pr, exceeds that of the source, the relay to destination link 
can fully support the rate of the source to relay channel. Owing to the weak source to destination link - 
\Hsd\ 2 is smaller compare to other two channel transfer functions - the overall relay channel effectively 



(23) 
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Fig. 5. DF achievable rates with a) no permutation at the relay and b) strong channel matching at the relay as source 
power Ps varies from 5 to 15. Relay and destination noises are Gaussian and of unit variance. \Hsr\ 2 = [1.51.8], \Hsd\ 2 = 
[0.70.5], \H RD \ 2 = [0.81] and P R = 10. 

behaves like a two-hop channel without the source to destination link. This verifies the fact that the 
channel matching with a modified amplify-and-forward works well in multihop channels (see (19\ ). 

We explain the loss in performance due to relay permutation as follows. If we permute the relay inputs, 
the only affected term in the DF achievable rate expression in Theorem Q] is C^nDF' which increases 
when the source and relay cooperatively send the bin index of the message to the destination. By sending 
the i-th sub-carrier relay input through the j-th sub-channel in the relay-destination link (i ^ j), one 
cannot exploit the potential cooperative gain in a single sub-channel. 

D. Comparison of achievable rates 

The example in this subsection is motivated by underwater acoustic communication. UW channels are 
characterized by unique physical and statistical properties. The physical property that we are interested 
in is the attenuation which depends on the propagation distance and carrier frequency of the transmitted 
signal. For the statistical part, the channel is assumed to be WSSUS (Wide Sense Stationary with 
Uncorrelated Scattering). We model a UW channel by taking into account both properties to form a 
frequency-dependent fading multipath channel. 

Frequency-dependent Path Loss: For signals propagated through UW medium, its energy is attenuated 
as a function of both the distance d and signal frequency /. This attenuation or path loss is a combination 
of the geometric spreading and absoiption and can be written as in |[T2l 

A(d,f) = A d k a(f) d . 
20 
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DF rate with strong channel matching 






DF rate with no permutation 











The spreading factor k is set to 1.5. The absorption coefficient a(f) can be expressed emperically in 
dB/Km for / in KHz, using the Thorp's formula as IT301 

f 2 f 2 

101ogo(/) = 0.11 - +44- — - -2 + 2.75 x 10" 4 / 2 + 0.003. 



h(t,r) = 52hi[t)8(T ~ ±) 
i=0 



Statistical Channel Model: We consider that a transmission bandwidth of W » (A/) c (coherence 
bandwidth) is available to the user, thus the channel is frequency selective. The channel is modeled as a 
tapped delay line, where the number of taps are equal to the number of multipaths present, and it is given 
by L = ^ ^ , where (AT) C = j^jy is the delay spread of the channel calculated from the ray tracing 
model and T = ^ is the rate of sampling of the input symbols. Let h(t, r) denote a continuous-time 
channel impulse response (CIR) of linear time- variant (LTV) UW channel ||311 , 

L-l 

bJ^Mr - 

W 

WSSUS is commonly assumed to characterize the UW channel I13T1 . RUl i.e., E[h(t,r)h(t' ,r')] = 
Rh{t — t' ,t)S(t — r'), where Rh(t — t',r) is the autocorrelation function of the delay r between time 
t and t'. This implies that the {hi(t)} are mutually uncorrected. We consider {hi(t)} to be Gaussian 
random processes, hence uncorrelated scattering assumption make them statistically independent. 

The ambient noise in the ocean can be modeled using four sources: turbulence, shipping, waves, and 
thermal noise. The following empirical formulae give the PSD of the four noise components in dB re fi 
Pa per Hz as a function of frequency in kHz ||33Tl : 

101ogiVi(/) = 17 -30 log/ 

101ogJV s (/) = 40 + 20(s-0.5) + 261og/-601og(/ + 0.03) 

WlogN w (f) = 50 + 7.5^2 +20 log/ -40 log(/ + 0.4) 

101ogi%(/) = -15 + 20 log/. (24) 

Turbulence noise influences only the very low frequency region, / < 10 Hz. Noise caused by distant 
shipping is dominant in the frequency region 10 Hz -100 Hz, and it is modeled through the shipping 
activity factor s, whose value ranges between and 1 for low and high activity, respectively. Surface 
motion, caused by wind-driven waves (w is the wind speed in m/s) is the major factor contributing to 
the noise in the frequency region 100 Hz - 100 kHz (which is the operating region used by the majority 
of acoustic systems). Finally, thermal noise becomes dominant for / > 100 kHz. 
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Fig. 6. Channel model of a single-relay channel with ISI 



In this example, we compare DF achievable rate studied with respect to the direct transmission from 
source to destination and 2 hop relaying with the total input power constraint remaining same in all the 
cases. For simulation, we have taken (A/) c = 3.33 KHz for the SR and RD link and (A/) c = 5 KHz 
for the SD link. A carrier frequency of f c of 27 KHz and an available transmission bandwidth of 10 KHz 
are considered for all the 3 links. The physical attenuation of the channel is calculated using Thorp's 
formula. Rayleigh fading model is investigated where each channel tap is a complex Gaussian random 
process, whose variances sum up to 1. Noise is colored Gaussian as defined in (|24] |. with s = and 
w = lOm/s. A total input power constraint of P t = 20 dB is considered for all the schemes. We also 
assume that the the fading realizations are independent of each other and the channel state information 
is available at all the nodes. For the performance analysis, we average the achieved rate for a particular 
realization of the channel over all realizations of the fading states in order to capture the effects of fading. 
We use the channel model of Fig. 6. 

Fig. 7 plots the capacity bounds in bits/sec/Hz as we vary the relay position a. Comparing 2 hop, direct 
transmission with the cooperative DF scheme, it can be concluded that relay cooperation performs best 
in terms of achievable rate in underwater acoustic communication as expected but given a fixed square 
area/volume and a set of n > 3 nodes, the placement of the nodes that gives maximum rate between a 
given pair of source and destination, is still an open question and is worth investigating. 

E. Symbol asynchronous relay channel 

A relay channel is said to have asynchronism among the nodes if the codewords transmitted from the 
aource and relay do not coincide in time at the reciever. Frame synchronism refers to the ability of the 
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Fig. 7. Achievable rates and upper bound when h — 0.25 Km, cLsd = 1 Km and a varies from to 1.0 Km 

nodes to receive or initiate the transmission of their codewords in unison. In many practical situations, 
it is perfectly reasonable to assume that this type of synchronism is achievable with the help of channel 
feedback or cooperation among transmitters. In contrast, symbol synchronism is far more challenging 
to achieve due to the smaller time scales. Our interest in asynchronous relay channels is motivated by 
underwater acoustic communication networks, the slow speed of propagation of sound in water implies 
that significant asynchronism can occur in multi-terminal underwater networks. 

Asynchronism in multiuser networks has been examined in multiple contexts over the years from an 
information theoretic perspective; (see, e.g., 041 . ll27l and references therein). In this paper, we find the 
bounds on the capacity of a symbol-asynchronous Gaussian single-relay channel in which the node i 
linearly modulates its symbols employing a fixed waveform this could be a signature code or a 

pulse shape. We exploit the results of |[27l , which examined the symbol asynchronous Gaussian MAC, to 
show that our symbol asynchronous relay network is equivalent to a relay with finite memory. With this 
equivalence in hand, we can exploit our prior results for relay channels with inter-symbol interference 
in Section IV to determine closed form expressions for upper and lower bounds on the capacity of the 
symbol asynchronous relay channel. 
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1 ) Channel Model: For a single-relay channel, assuming frame synchronism and additive white Gaus- 
sian noise model, we can write the continuous time received signals as, 



vrV) 

VD(t) 



E xs(i)€s(t -iT- t S r) + n R (t) 
i=i 

n 

^2x s (i)Cs(t - iT -t S d) +x R (i)£ R (t -iT - t rd ) + n D (t), 



(25) 
(26) 



i=i 



where {xs(i)}^ = i,{x R (i)}^ =1 are the input sequences of the source and relay, respectively. £s(t),£ R (t) 
are the unit energy modulating waveforms of support [0,T] used by the source and relay. The delays 
or offsets ts R ,tsd,t R d account for the symbol asynchronism between the users and are known to the 
receiver. n R (t),riD(t) are additive white Gaussian noise at the relay and destination with power spectral 
density equal to a R and a D , respectively. We assume the same input power constraints as in 

We can obtain an equivalent channel model with discrete-time outputs whose capacity is same as that 
of the continuous time one described above by considering the projection of the observation process 
{2/fl(*)>2/£>(*)} along the direction of the unit energy signals and {£r(*)} and their T-shifts: 

>-(i+l)T+T SR 



VRW 



VDji 



yR(t)£s(t -iT - T SR )dt 



iT+rsR 
(i+l)T+r RD 

iT+T jD 



UD(t)Cj(t -iT - T jD )dt, 



(27) 



where, j G {R, S}. By substituting (|25T ) into d27l) and by defining the cross-correlations between the 
assigned signature waveforms and £r(£) as (assuming without loss of generality that t R d < t~sd) 

Pes = l 6i(*)£s(* + trd - T SD )dt, 
Jo 

PSR = / €R(t)£s{t + T + Trd - T S D)dt, 

Jo 

it follows easily that the discrete-time channel output is given by, 

VR.{i) = x s {i)+n R {i) 



b1<i 



yDR{i) 

VDs(i) 

where,H(0),H(-l) = H T (1) are given by, 

1 PRS 



XR{i+ j) 




nDR(i) 




+ 




x s {i+ j) 




nDs{i) 



(28) 
(29) 



H(0) 



PRS 



1 



,H(1) 



PSR 
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Fig. 8. Discrete time equivalent of a symbol-asynchronous relay channel 



and 1 < i < n (xs(0) = xs{n + 1) = 0, xr(Q) = xr(ti + 1) = 0); the discrete-time noise process 
{[ nr)n{i) riDs(i) ] T } is Gaussian with zero mean and covariance matrix: 



E 



nDn{j) n DS (j) 



a 2 D H(i-j). 



nDs{i) 

Since the receivers at the relay and destination know the assigned waveforms and £r(£) as well as 
the symbol epochs {iT+r q }, q G {SR, SD, RD}, these receivers can compute {j/i?(i)}f =1 , {yi)i?(i)}f =1 
and {yDs(*)}™ = i by passing the observations through two matched filters for signals £s(i) and £r(£), 
respectively. The key observation is that this operation yields sufficient statistics for the transmitted 
messages [35 ] and the equivalent channel model is a MIMO relay channel with memory 2 (see Fig. 8). It 
is clear from the equivalent discrete time channel model that the capacity is independent of the delay of 
the signal coming from source to relay, as the channel impulse responses of the three links in the relay 
channel are functions of the relative offsets between the users in the MAC (multiple-access channel) 
portion of the relay. If either prs = 1 or psr = 0, then the channel becomes memoryless, as signals are 
symbol synchronous. For example, if the users are assigned the same signal and the channel is symbol 
synchronous, both outputs coincide and are equal to 

VR(i) = x s (i) + n R (i) 

y D (i) = x s (i) + x R (i) + n D {i). 

The channel is then a conventional discrete-time Gaussian relay channel, whose capacity is discussed 
in @. If the assigned signals are not equal, but the users remain symbol synchronous, then the outputs 
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reduce to the memoryless MIMO relay channel, 

UR(i) = xs(i) + n R (i) 



VDR{i) 




1 p 




x R (i) 




nDR{i) 








+ 


VDs(i) 




. p 1 . 




xs(i) 




nos{i) 



where {[nDR(i)nDs(i)] T } is an independent Gaussian process with covariance matrix given by, 

a 2 D a 2 D p 

and p = Jq £s(t)f;ii(t)dt. The capacity of memoryless MIMO relay channel is studied in [36). 

2) Achievable rates and upper bound: We examine two relay coding strategies: a) Decode-and-Forward 
(DF) and b) Compress-and-forward (CF) and the "cut-set" upper bound. As CF and DF have differing 
regimes in which they offer the best rate ||9] for memoryless channels, it is of interest to investigate both 
coding strategies for the symbol-synchronous relay channel as we do herein. 

Theorem 7. The DF achievable rate of a symbol asynchronous relay channel with input power constraints 
(E]) is given by, 

C df (P s ,Pr) = sup^minjy C du, 

C (\( p s(u) + Pr(u) + 2V(l-aH)Ps(w)P fl (u)/)H 
Jo K^D 

where, C(x) = log(l + x),p(uj) = pus + psrcos(lu) and Ps(^>) and Pr(u>) are the power allocated by 
the source and relay in the band uj and a{ui) is the correlation between the source and relay codewords 
in the band uj. 

The theorem is proved in Appendix E. 

Theorem 8. The CF achievable rate of a symbol asynchronous relay channel with input power constraints 
(0) is given by, 

1 



2 77 



C C f{Ps,Pr) = sup — / log - A [^ \ - dui 

4^ Jo 1 + N R {u) 

log-f-^ < 0, 
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where, A{co) = 1 + N R (u) + 2P s (oj) + N R (u)P 3 (u), B(u) = N R (u)((l + P<?(u/))(1 + M")) " 
Ps{oj)Pr(oj)p 2 {oj)) and Nr(lo) is the compression noise at the relay, which limits the amount of 
compression that can be performed at the relay. 

Theorem 9. The upper bound on the capacity of a symbol asynchronous relay channel with input power 
constraints ([2]) is given by, 

C U p P er(Ps, Pr) = sup -|- min jy C y y-^- + -^-J a(w)P 5 (w)^ dw, 

1^ C (\( p s(u) + Pr(u>) + 2^{l-a(io))P s {u;)P R {uj)p{Lo) 

JO \ a D 
1 



+- r a(u>)P s (u)P R {u } )(l - P \oj)) )dw\, 



The proof of these two Theorem [8] and [9] are very similar to the Theorem [7] and thus omitted for 
brevity. 

The results can be easily extended to the case where the transmitters only know that the crosscorrelations 
(pRS, Psr) that parametrize the channel belong to an uncertainty set T, which is determined by the choice 
of the signature waveforms. For example, if both users are assigned a rectangular waveform then the 
uncertainty set is equal to the segment T = {0 < p R s < 1, < psr < 1, Psr+Prs = !}• The achievable 
rate of the Gaussian asynchronous relay channel under this condition is obtained by taking infimum of 
the rates in Theorem [7] and [8] over the set T. This follows simply because for reliable communication a 
code has to be good no matter which actual channel is in effect. 

We will now compare DF and CF achievable rate for symbol-asynchronous relay and show the 
respective optimal regions with an example. We place the nodes such that the source, relay and destination 
are aligned, and the distances of the direct paths in each of the links are given by dsR = d, d R D = 1 — d 
and dsD = 1- This corresponds to the relay channel of Fig. 6 with h = and a = d. The channel impulse 
response at each of the three links follows inverse power law, .i.e., Hsr = dr~ ,H$r = (1 — d)~~ and 
Hsd = 1> where a is the attenuation constant. Modulating waveforms £s(t) and $, R {t) are rectangular 
waveforms of unit energy and finite support T. For simplicity, the additive noises at the relay and 
destination are white, Gaussian and of unit power. The relative delays between the users are proportional 
to the distance, for e.g., t$r = Td,T R rj = T(l — d) and t$d = T, which means if the relay is at 
the source, t$r = and trd = tsd = T, and similarly, if the relay and destination are co-located, 
rsR = tsd = T and t rd = 0. 
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Fig. 9. Rates for symbol-asynchronous relay network for Ps = 10, Pr = 10, a = 2 and varying d 

With equal power constraints at the source and relay, we plot DF and CF achievable rates and upper 
bound on the capacity of this channel model in Fig. 9, as we move the relay from source to the destination. 
It can be seen that when the relay and destination are co-located (d — > 1), then relay can send its input 
directly to the destination without quantizing it and thus Nru = 0, Vz. In this case CF rate performs 
optimally, matching the cut-set upper bound as y 7 ^ = y 7 ^, a deterministic function of y 7 ^. In contrast, 
when d — > 0, DF is optimal. Note that, when d — > the channel is symbol-synchronous and memoryless 
as trd = tsd and £s(t) = £,n{t). These trends for CF and DF for the LGRC mimic those for the 
memoryless relay Q. 

VII. Conclusions 

In this paper, we have derived single-letter expressions for the achievable rates and an upper bound on 
the capacity of a relay channel with inter-symbol interference and additive colored Gaussian noise. Such 
systems find wide application in a variety of wireless communication systems, in particular, underwater 
acoustic communication channels. We have examined two important relay channel coding strategies, 
decode-and-forward and compress-and-forward; further, the upper bound is a generalization of the cut- 
set bound for multi-terminal networks. Some of the conditions for which the channel capacity can be 
computed, such as degraded relay channels, are delineated. The proof methods rely on the decomposition 
of the multipath channel into parallel channels via a DFT decomposition. Thus, our results suggest the 
optimality of OFDM input signaling even for relay channels. As such, optimal achievable schemes for 
memoryless channels are likely to have similar properties when extended to relay channels with finite 
memory. Numerical examples were provided to illustrate properties of the results. Ongoing work is 
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extending these results to consider highly asynchronous links and developing practical coding strategies 
to achieve theoretical performance. Future work would be to investigate the Amplify-and-Forward (AF) 
strategy at the relay. Although, we numerically observe that decomposition into parallel channels is sub- 
optimal for AF relay, we can still probably come up with a simple linear filter at the relay, which will 
outperform the DF and CF achievable rates for some values of channel parameters. 



Appendix A 
Proof of Lemma [3] 

Proof: To prove this Lemma, we need to show that Eqn. ([T6T l subject to the power constraints © 
and rate constraint (fTTT i is maximized by a diagonal ^5 and ^ r. We prove this by showing that diagonal 
$ s and ^r maximizes the objective function Eqn. (fT6l ) without altering the constraint set (fTTT ). Consider 
the first term in Eqn. (fT6l ). The matrix inside the determinant operator can be decomposed into two parts. 
We observe that maximizing the expression below over \&s 



arg max — log 

* s 2 









Cr + C 



R 



+ 



Dsd^S^sD VsdVsWsR 



is equivalent to maximizing, 



(a) 



(6) 



arg max — log 

*s 2 



arg max — log 

9 S 2 



D SD C D D SD 

S v ' 

C 





D 



SR 



Cr + Cr)D 



'SR 



+ 



*5 



C + ^s 



1 



arg max - log |* s | |*S - (C + ^s)* 5 1 ( D + *s) 
ilogltfsllCtf^D + C + Dl. 



(30) 



Here, (a) follows since exchanging rows does not change the absolute value of the determinant and (b) 
follows from the properties of the determinant of a block matrix (see 11371 ). By Hadamard's inequality 
EH, the expression in Eqn.(l30b is maximized when ^5 is diagonal. 

Although we have shown that diagonal maximizes the objective function, it remains to be shown 
that by choosing tyg an d ^r to be diagonal, the compression rate Cr at the relay is not altered. The 
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compression rate is determined by the inequality constraint (fT71) . which can be rewritten as, 



log 



> log 



VsbPsWsr + Cr + Cr DsrVsWsd 



VsD9 S Ty SR 



D SD ^ s Dl D + 



log 



Dsd^S^sd + n R D*RD RD + C D 



f(*S,*R) 



(31) 



Now we have to establish that diagonal ^5 and ^r does not reduce the compression rate constraint set. 
We prove this by showing that for every choice of arbitrary an d ^J?> we can find a diagonal and 
ty* R , which either gives the same constraint on the compression rate or improves it,. i.e., 

First for any choice (diagonal or non-diagonal) of we will find a condition on ^r which will 
maximally enlarge the compression rate constraint set. We consider the second term in the RHS of (f3TT >. 
which is a function of ^!r, where ^!r is a general non-negative definite matrix, not necessarily diagonal. 



log 



(a) 



(l>) 



log 



log 
log 



E 5 A 5 E^ + Ci 
As + E+CiEs 



< log|A s + A Cl | 



(32) 



where in (a), ^5 = EgA^E^ is the spectral decomposition of ^5 with Eg being the unitary eigenvector 
matrix associated with the diagonal eigenvalue matrix Ag. (b) is true because eigenvector matrix is unitary 
and (c) follows from the well known Hadamard's inequality (see e.g. [21']), where Ac 1 is the eigenvalue 
matrix of Ci. 

Since increase in the second term in the RHS of (OTI ) will make the constraint set larger, for a fixed 

choice of non-diagonal ^g, equality is achieved in d32l ) if ^r is chosen from a family of positive 

1 



definite matrices (by varying Ac x ) diagonalized by Eg and of the form ^r = D^DgofEgAcjEt 



D S pCDUg D )Dg D D RD , satisfying the power constraint d2j at the relay and maximizing the determinant 



in ( [321 . For diagonal ^g, it is easy to verify that diagonal ^r will make Ci diagonal. 
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Now with such choice of ^S>r, we will show that it is sufficient to consider only diagonal tyg- Let us 
consider the RHS of (|3TT) again, 

log 



DsrVsWsr + C R + C R ^sr^s^sd 



-log 
= log 



Cr + Cr 
C D 
log|^ s + Ci| 



+ 



D S i? 
Vsd 



D 



SR 
D 



SD 



= log 



log 



C 2 
C 3 



(«) 



V s s + C 3 

's 1 



log|* s + Ci| 



log|*s + Ci| 



log |* s | + log I (* s + C 2 ) tfg (*s + C 3 ) - *s| - log + Ci| 
log |* s | + log |C 2 + C 3 + C 2 ^5 1 C 3 | - log |* s + Ci| 



= log|^ s |+lo, 



log|*s + C 



log 



In + ^5Cx 



log|* 5 + Ci| 



(33) 



where C 2 = [C R + C R ) D SR , C 3 = D^ D C D D 5D and Ci = (C 2 + C 3 ) C 2 1 C 3 1 are all diagonal 

A B 

matrices and (a) follows from the fact that det 



C D 



= det (A) det (D - CA _1 B), with A = D = 

^5,B = $5 + C 3 and C = ^s + C 2 . The constraint set {^ s ■ tr(^ s ) < Ps} is closed and bounded and 
g(^s) is continuous everywhere. Thus by the extreme value theorem (see 11381 ). g(^s) has a maxima 
and mininma in the constraint set and the extreme points can be shown to be attained by the diagonal ^5 
by differentiating g(^s) w - r -t- and solving the KKT conditions (the proof is similar to the proof of 
Theorem 3 in j39] and thus omitted for brevity). So for every non-diagonal ^5, we can find a diagonal 
^>s which gives the same value of g(^s)- Thus by choosing and ^r to be diagonal, the compression 
rate is not reduced and a diagonal ^5 maximizes the objective function Eqn. (fT6l ). This completes the 
proof. ■ 



31 



Appendix B 

Proof of Optimality of CF Achievable Rate 

Proof: 

We re-examine the achievable rate for compress-and-forward strategy (see Eqn (fT5T>). If y^, c is a 
deterministic, invertible function of y r R then, 

nCF = supI(x s ;y D ,y R \x R ) = supl(x s ; y D , y R \x R ), 

subject to the constraint, 

I(x n R ;y n D c ) > I(y n R c ;y n R c \x R ,y n D c ) 

I(x" R ;y n D c ) > h{y%\x%y%) 

I(x n R ;y n D c ) > I(x n s ;y n R c \x%y n D c ) 

I(x n s ;y n D c \xl)+I(x n R ;y n D c ) > I(x n s ; yW\ XR ) + I(x n s ; y n R c \x R , y n D c ) 

I(x n s ,x n R ;y n D c ) > I(x- s ;yf,yW\x n R ). 

Here, (a) follows from the fact that /i(y^. c |y^ c , x R , y^f) = as y^ c is a deterministic, invertible func- 
tion of y^. Under this condition it is clear that the cut-set upper bound is also given by, Cn P = 
sup/(x5;y^ c ,?/2) C |a;^) which in turn is equivalent to C^ CF . ■ 

Appendix C 
Proof of limiting DF Achievable Rate 

Proof: 
We need to show that, 

lim C c nDF (P s ,P R ) = C DF (P S ,P R ). 

n— >oo 

To prove this we will use a theorem on minimax optimization ||26l stated below. Given, : X x Z \— > 1Z, 
consider the following minimax optimization problem, 

min max$(x, z). 

x&X z&Z 

Define, 

r x( z ) = — &(x, z) if z £ Z, r(z) = maxr I (z), 
t z (x) = <3?(x,z) if x £ X,t(x) = maxt 2 (x). 
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Theorem 10. H26\l If X and Z are convex and compact, t z {.) and r x (.) are closed and convex for each 
z £ Z and x £ X, respectively, then 



Now, 



minmax$(i,z) = maxmin<3?(x, z). 



CnDF( p s,Pn) = maxmm{C^ nDF ,C^ nDF } 



where, A = 1 — A and here (a) follows from the fact that XC^ nDF + ACf n£)i? is a line connecting C\ nDF 
and C^ nF)F , A = and A = 1 are two extreme points of this line. Let, 

U n = {a(uji) : < Ufa) < 1} 



Vn = \p S {ui) : ^f^PsH) < P S \ 
lp R (ui) : lj2PR(^i) <Pr\ 



W n = 

Z n = {z n = (u n ,V n , W n ) \ U n £ U n , V n £ V n ,W n £ W n } 

X = {A : < A < 1} 

$(x,Zn) = \C{ n + \C^ n . 

It is easy to see that both X and Z n are convex sets and they are compact also since they are closed 
and bounded (assuming the peak power in a sub-band is bounded). And since <&(x,z n ) is a continuous 
and bounded function (as capacity is bounded) of (x,z n ), the solution of the problem exists for all n. 
So we can write, 

max min^fx.Zn) = max min <5(x, u n , v n , w n ) 

z n ez n xex u„eU„,v n eV„,w n eW n xei 

= max max max mm^(x,u n ,v„, w n )- 

For a fixed w n £ W n , t Wn (x) = <E>(x, z n ) is a closed and convex function of x and similarly, for a fixed 
x £ X, r x (w n ) = —$>(x,z n ) is a closed and convex function of w n (can be proved using the fact that 
if /() and g() are concave function of x and g{) is nondecreasing, then g{f(x)) is a concave function). 
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And hence by applying Theorem [TOl 



max mm (XC{ nDF + XC^ nDF ) 

{z n &Z n } {x&X} 



max max min max {XCf nDF + XC^ nDF ). 



Now since — <J>(x, z n ) is also convex function of u n and v n for a fixed value of the other parameters, we 
can apply the same theorem twice to finally get, 



max mm {XC{ nDF + XC$ nDF ) 

{z„£Z n } {x&X} 



Now we show that, 



lim max(AC 1 c nZ3F + XC^ nDF ) 

n— >oo Zn 



mm max (XC^ nJDF + XC% nDF ). 

{x&X} {z&Z n } 



max.(XCiDF + XC 2 df) 
z 



max &(x, z), 
z 



where, 



Z 



(u,v,w) 

(a(u}),Ps(u),P R (e>)) : < a(u>) <^^J p s(u) < p s,^ f Pr{") < Pr 

Since, 3>(x, z) is a strictly concave function in each of u,v and w and since each of U,V and W are 
convex constraint sets, <£(x, z) achieves its maximum at some unique z = z* . Similarly, <£(x, z n ) attains 
its maxima at some unique z n = z*. 

If a function is bounded and almost everywhere continuous on the interval [— tt, tt] then it is Riemann 
integrable on the interval,i.e., 



1 n 1 f' 71 

lim = — f(x)dx. 

1=1 J -n 



Since the capacity of a power constrained system is finite, it can be shown that (for details see Lemma 
3 of 03), 

lim $(x,z*) = $(x,z*) 
lim max(XCi nDF + AC| nDF ) = max(ACi_DF + XC 2 df)- 

n— >oo Z n Z 

As Z is closed and convex, applying Theorem [10] again to exchange the min-max, we get our desired 
result. ■ 
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Appendix D 
Power Allocation for DF protocol 

Proof: 

Exchanging integration and infimum operation reduces the original problem into n optimization prob- 
lems. Consider one such optimization problem in the sub-band i for the DF lower bound on the capacity. 

nwxmin {C (P(uji)) ,C (asmPsi^i))} , 

where, Pt{ui) = Ps{^i) + Pr^i) and Ps{^i) = Psi^i) + -Pj(wj). Psi^i) i s use d by the source for 
transmission to the relay, Pg(oJi) for transmission to the destination and Pft(wj) is the power allocated 
by the relay in the sub-band 

For fixed P 2 {oJi) = Pgi^i) + Pr^i), the rate C (P(uii))) is maximized when we set, 

r>2/ \ a SDi D / \ 

Psi^i) = Fb(u>i) 

aSDi + dRDi 

P R (u t ) = QS f l P 2 (u t ). 

asm + a>RDi 

We then get a simplified problem, 

C* = max mm {C\(uji), C 2 (uJi)} where, 
Ci(wi) = C {a S RiPl{uJi)) 

C 2 (uJi) = C (asDiPsi^i) + (a S Di + a RD i)P 2 (uJi)) . 

Lemma 4. If asRi < asDi then Cu < C 2 i yPt(u>i), otherwise for maximizing P t {uii), Cu = C 2 i- 

Proof: The first part of the lemma is obvious. For the second part, let P t * = P u + Pg* maximizes 
the objective function and C u < C 2i . Then by choosing = (1 + e)Pg*,Pu = P u — ePg*, we can 
increase Cu as it is a increasing function of P^ and decrease C 2 i- So by continuity, at maximizing P t *, 
Cu = C 2 i. We can use similar techniques for the case of C 2 i < Cu. ■ 
If o-SRi < o-SDi the sub-channel is non-degraded,and Cu < Cu. So, C* = maxCij and then solving 
the optimization problem we get, C* = C ^asRi (vt — ^j^j ^ • The corresponding power allocations 
are given by, 

1 



asRi 

P?( Ui ) = P t >*)^J>*) = P* R (ui) = 0; 
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is given no power as it has no effect on the achievable rate of the sub-band. 
If asm > asm the sub-channel is degraded, and the sub-channel rate is maximized when 



O-SRiPs*^) — a SDiPs*( UJ i) + ( a SDi + O-RD^P^i^i 



asRi - asDi D i* , 

_i 5 l^iJ- 



Now, using the relation = P^*(a;j) + P%{uJi) we get, 



i+ q ^~ Q5d M p1*K). 



The achievable rate is maximized when Ph* ( 



S ^i) 



O-SDi + Oi?,Di 



m / \ a^ffi - asDi 
P 2 (Wi) = — | v t 



Ps*{ui) = asm 

Pfii^i) = a RDi 



dSDi + a RDi 

asRi — asDi 



which implies that, 
1 



USRi 



1 



{asm + a RDi ) 2 \ a s n 
asRi — a,SDi ( J 



(dSDi + CLRDi) 2 V a SRi, 

where u t is the power price chosen to satisfy the overall total input power constraint. 



Appendix E 
Proof of Theorem [7] 

Proof: Before proving the theorem, we introduce two key lemmas. 



Lemma 5. 



det hn + -^E[x n x nl ]G 
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where, 



PRsIn + PSR 
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PSR 1 
PRS 



PRS 
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This Lemma can be easily derived from Lemma 1 of ||27| . The key to showing Theorem [7] is proving 
that the DFT decomposition is again optimal for DF. To this end, we will need the following Lemma. 



Lemma 6. 



det I 2n + 



a 



D 



^R ^RS 
^SR *S 



In D 

D* I n 



< n { det /s + 



8=1 



1 



Ipmi 4>RSii 

ipSRu ipsa 



1 da 
dl 1 



where, D is a diagonal matrix with da as it's i-th diagonal element. 

The proof of this Lemma uses appropriate permutation matrix P to block-diagonalize the LHS, similar 
to the proof of Lemma [3] With Lemma [5] and [6] in hand, we can now prove the Theorem [7] 

The input-output relation of a discrete-time Gaussian circular MIMO relay channel model is given by, 



xs{i)+n c R {i) 
Vdr^) 



(34) 
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Xr{% + l)n 
Xs(i + l)n 



x s {i 
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"l)n 
n DR^) 

n c DS {i) 



1 Prs 
Prs 1 



xr{i) 
x s (i) 
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for 1 < i < n; where {(i) n ) equals i modulo n except when s is zero or an integer multiple of n, in 



n 



DR 



(i) ri 



DS\ 



are 



which case ((i) n ) = n. The noise processes ovar each n-block {n c R (i)} and | 
circular and its autocorrelation is a periodic repitition of the autocorrelation of the original noise samples 
within an n-block as defined in [15]. The output of the channel in vector form can be written as, 
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(37) 



where, the Gaussian noise processes {n c R (i)} and j n c DR (i) n c DS (i) j have covariance matrix a R I n 
and a 2 D G, respectively. So, 

I(x%x R ;t D c ) = Kyl c )-h(yW\x n S ,x R ) 

= h{Gx n + fil c ) - h(Gx n + fi%\x%, x n R ) 



(a) 



(6) 
< 



h(Gx n + n n D c ) - h(nl c ) 



log det (cov(Gx n + n n D c )) - - log det (a 2 D G) 



logdet(l 2n + 4 r Mx , V lT lG 
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(38) 
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where, x n = {xn{i),xs(i)'}'i = i and (a) is justified since noise is independent of the inputs, (b) follows 
as Gaussian input maximizes entropy for a given input covariance matrix, (c) follows from the fact that 
S is a circulant matrix and hence it gets diagonalized by the DFT matrix F i.e., S = FDF^, (d) follows 
from the Lemma [5] and (e) is true because of Lemma [6] 

Here, da is the z-th eigenvalue of the circulant matrix S and is given by the DFT of the first column 
of S and thus da = p RS + psRe~ juJl = p(u%). Let, ip m = P R ((jJi),ipSii = Ps(^i) be the are the power 
allocated by the source and the relay for i-th component of the channel and a(wj) be the correlation 



between X$i and Xjh as defined in |6], then ip R su = \/ (l — a(ui))Ps(uJi)P R (iOi) and subtituting these 
values in (l38l) we get, 

i n f i 

I(x n s ,x n R ;y n D C ) < - ^ log 1 + —(Ps(ui) + Pr^i) + 2^(1 - a(u; J ))P 5 (^)P i? (^)p(^)) 



Similarly, 



2 1=1 N 'LI 

+ ±-a(oj)P s (GJ i )P R (GJ i )(l - p 2 (cji)) ) (39) 



Hx n S ;y n R C \x n R ) = h{x n c +nl c )-h{n R c ) 



< ^logdet (in + \t. 

1 / 1 



-logdet I„ + — * 

_■ \ (J 



(») iA / i \ 

< ? 53 lo S 1 + — <*(ui)Ps(w)) (40) 
1 i=i V / 

where, x™ = x§|x^ and S is the conditional covariance matrix and it can be expressed in terms of the 
input covariance matrices and its given by S = E[x™(x™) T ] = Eg — Es^E^ 1 !]^. (a) can be shown 
using Lemma [2] Now combining Eqn. d39l and d40l and taking the limit in the block-length n, we get 
the expression of Theorem [7] ■ 
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